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Predicting Marketing Campaigns Using Customer-Specific 
Response Probabilities and Response Values 

This application claims priority to U.S. Patent Application Serial No. 10/413,442, filed 
April 14, 2003 and entitled "ASSIGNING CUSTOMERS TO ACTIVITIES IN MARKETING 
CAMPAIGNS," and to U.S. Patent Application Serial No. 10/445,722, filed May 27, 2003 and 
entitled "PREDICTING MARKETING CAMPAIGNS HAVING MORE THAN ONE STEP." 

5 Technical Field 

The invention relates to marketing campaigns. 

Background 

Automated marketing campaigns may involve one or more computers controlling 
campaign activities directed to groups of existing and/or prospective customers. Typically, a 

10 company engages in a marketing campaign as a way of communicating specific business 

messages. For simplicity, all the recipients of such marketing messages will here be referred to 
as customers, whether or not they have an existing customer relationship with the company. The 
messages usually can be anything from a pure advertisement to a direct offer, which the 
customer may accept. Frequently, the company running a marketing campaign seeks an initial 

15 response from a customer to gauge interest in the subject of the campaign, and then intends to 
use the response in directing further campaign activities toward that customer. 

In essence, running a marketing campaign consists of deciding which customers (i.e., 
which target group) should receive what offer (or communication) and thereafter executing the 
campaign accordingly. It is necessary to decide which customers to include in the campaign and 

20 which to leave out. Moreover, it must be decided which campaign activities should be 

1 
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performed in the campaign — and to which individual customers — and which campaign activities 
should not be used. 

In addition, companies are often interested in trying to predict the outcome of a 
marketing campaign before it is carried out. Software programs have therefore been developed 
5 that use statistical relations and probabilities as a way of estimating what may be the results of 
the marketing campaign in terms of response rate, revenue, net profit, etc. In other words, such a 
program may assign a particular target group to a certain campaign activity and try to predict the 
outcome of actually executing that campaign activity toward the target group. 

Target groups, however, can be very large — on the order of several hundred thousands, or 

10 millions, of customers or more. It follows that even with a modest number of alternative 

campaign activities, there may be a great number of possible combinations of customer-activity 
assignments. It would be easy to simply assign the customers to marketing activities at random, 
but this approach is not very likely to result in optimum results for the marketing campaign. 

One suggested way of optimizing the assignment of customers to campaign activities is 

15 the sometimes-called "Greedy" approach. This involves assigning the customers one at a time, 
and for each new assignment calculating the effect on the predicted result of the marketing 
campaign. Assume that using this process, 1,000 customers have already been assigned to four 
campaign activities. That is, each of the 1,000 customers presently is assigned to one of the four 
campaign activities. The Greedy approach then prescribes that the 1,001st customer should be 

20 assigned to that campaign activity that will most increase the predicted result of the campaign. 

The Greedy approach determines the predicted effects of assigning the 1,001st customer to each 
of the four campaign activities and thereafter selects the best one. This process is repeated for 
the 1,002nd customer, and so on. The Greedy approach stops when it cannot improve the 
predicted results without ignoring a constraint on the marketing campaign. 



Attorney's Docket No.: 13906-132001 / 

There are, however, drawbacks with applying the Greedy approach by itself. The Greedy 
approach is likely to find some maximum in the predicted campaign result, because it continues 
to assign the customers until it cannot improve the predicted result any further. But this 
maximum may be only a "local" maximum, that is, it may be greater than what is predicted for 
all similar customer-activity assignments, but it may be less than a "global" maximum that is the 
best possible results than can be predicted given the particular set of customers and activities. 
And because the Greedy approach always moves toward increased predicted results, it may be 
incapable of "leaving" a local maximum, because any change in the locally optimal customer- 
activity assignments may lead to a decrease in the predicted value. 

It has been attempted to overcome some of these disadvantages, for example by using 
what is sometimes referred to as a "Taboo" search. In order to have the algorithm depart from a 
local maximum it has identified, it becomes necessary to allow a decrease in the goal value. A 
Taboo search typically records 20 or so of the most recent assignments of customers to 
marketing activities in a Taboo list. As long as an assignment is on the Taboo list, the Taboo 
search will not try that assignment again. This arrangement is used with the expectation or hope 
that the Taboo search will not revert to a previously visited local maximum, because the most 
recent assignments are "off limits" as long as they remain on the Taboo list. 

But also the Taboo search may have disadvantages. Despite the use of the Taboo list, it 
is possible that the search algorithm will return to a previously visited local maximum, because 
the previous assignments are only blocked off temporarily. Revisiting an earlier local maximum 
does not bring the Taboo search any closer to the optimal result; rather, the search may exhibit a 
circular pattern of repeatedly identifying the same local maximum. The fact that the Taboo 
search has some tendency to return back to previous local maxima affects its ability to efficiently 
and quickly locate an overall, global, maximum. 
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Summary of the Invention 

The invention relates to marketing campaigns and may be embodied in methods, systems 

and software. In a first general aspect, the invention provides a method of predicting outcomes 
of marketing campaigns. The method comprises determining a response probability for each of a 
5 plurality of customers, the customers being intended targets of a marketing campaign. The 
method comprises determining a response value for each of the customers that indicates a 
predicted value of a response to the marketing campaign by the customer. The method 
comprises predicting an outcome of the marketing campaign using the response probability and 
the response value. 

10 In selected embodiments, the response value is determined using a purchase history of the 

customer. If a purchase history is not available for a customer, a response value may be 
determined using purchase history of at least one similar customer. For customers where no 
customer-specific response value is determined, a default response value may be used. 

Inventive methods may be applied in campaign prediction that involves use of optimizing 

1 5 algorithms. In selected embodiments wherein at least one campaign step in the marketing 
campaign comprises a plurality of alternative campaign elements, inventive methods further 
comprise assigning the customers to the campaign elements using an optimizing algorithm. The 
optimizing algorithm may assign and reassign the customers to the campaign elements while 
evaluating the predicted outcome of the marketing campaign, without reassigning a customer to a 

20 campaign element to which the customer has previously been assigned. 

Inventive methods may be applied in predicting campaigns that have more than one step. 
In selected embodiments inventive methods further comprise predicting a number of responses to 
be received if a first campaign step were performed toward a plurality of customers. A target 
group is selected from the plurality of customers using response probabilities for the customers, 
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the target group being substantially equal to the predicted number of responses. An outcome of 
performing the second campaign step toward the target group is predicted. If the target group 
initially is not equal to the predicted number of responses, the target group may be adjusted to be 
equal to the predicted number of responses. 

In a second general aspect, the invention provides a system for predicting outcomes of 
marketing campaigns. The system comprises program instructions comprising a response 
prediction module that, when executed by a processor, determines a response probability for 
each of a plurality of customers, the customers being intended targets of a marketing campaign. 
The system comprises program instructions comprising an evaluation module that, when 
executed by a processor, determines a response value for each of the customers that indicates a 
predicted value of a response to the marketing campaign by the customer, and that predicts an 
outcome of the marketing campaign using the response probability and the response value. 

In a third general aspect, the invention provides computer software, tangibly embodied in 
at least one of a computer-readable medium and a propagated carrier signal, for predicting 
outcomes of marketing campaigns. The software comprises instructions to perform operations 
comprising: 

determines a response probability for each of a plurality of customers, the customers 
being intended targets of a marketing campaign; 

determines a response value for each of the customers that indicates a predicted value of 
a response to the marketing campaign by the customer; and 

predicts an outcome of the marketing campaign using the response probability and the 
response value. 

Advantages of the invention may include one or more of the following. Improving multi- 
step marketing campaigns by predicting their outcomes and using the predicted results in 
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revising the campaigns. Improving chances of identifying unprofitable or undesirable marketing 
campaigns or steps thereof before they are launched. Being able to predict an entire multi-step 
campaign step-by-step. Being able to predict subsequent steps after executing a step of the 
campaign. Finding superior customer-activity assignments by improved optimization. Avoiding 
the disadvantage of repeatedly returning to a local maximum. Enabling the optimization to seek 
additional maxima. Improving the prediction of marketing campaigns by using customer- 
specific response probabilities and response values. 

The details of one or more implementations of the invention are set forth in the 
accompanying drawings and the description below. Other features and advantages of the 
invention will become apparent from the description, the drawings, and the claims. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a computer system containing components in accordance 

with the invention; 

Figure 2 is a schematic illustration of a view that may be displayed by the system in 
Figure 1; 

Figure 3 is a flow diagram of a process that can be performed by the system in Figure 1; 

and 

Figure 4 is another flow diagram of a process that can be performed by the system in 
Figure 1. 

Like reference numerals in the drawing indicate like elements. 

Detailed Description 

Figure 1 is a block diagram of a computer system 100 containing components according 
to the invention. The system 100 contains a processing unit 110 with a processor 120 that, 
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among other things, executes instructions stored in memory. Input devices 130 are operably 
connected to the processor 120. For example, the input devices 130 may include a mouse, a 
keyboard, or devices with additional functionality as will be described later. A display device 
140 may be operably connected to the processor 120 and may provide video output for the 
5 system 100. For example, the display device 140 may display one or more screens for a user of 
the system 100. Output devices 150 may be operably connected to the processor 120, for 
example to output information to the user of the system 100 or as part of running a marketing 
campaign as will be described later. 

The processing unit 1 10 may comprise a memory 160 operably connected to the 

10 processor 120. As is conventional, the memory of the processing unit 110 may include random 
access memory (RAM), read-only memory (ROM), or a combination of RAM and ROM. The 
ROM may provide non- volatile data storage for the system 100. During operation, program 
instructions may be loaded into the RAM such that the processor 120 can execute them. 
The memory 160 may comprise customer objects 161, which are data structures 

15 representing customers to which marketing campaigns may be directed. The memory 160 may 
comprise marketing activities 162, which represent steps of marketing campaigns that can be 
performed by the system 100. An assignment module 163 may be capable of assigning each of 
the customer objects 161 to specific ones of the marketing activities 162. By assigning a 
customer object to a marketing activity, the assignment module 163 provides that when the 

20 marketing activity is performed, it will be directed to that customer (and to any additional 

customer who may also have been assigned to the activity.) The assignment module 163 may 
record the assignments in a binary map 164. For example, the binary map 164 may comprise 
flags settable for each possible customer-activity assignment. 



7 
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The memory 160 may comprise an evaluation module 165 that is capable of determining 
a predicted value of the marketing campaign for each assignment of the customer objects 161 to 
the marketing activities 162. As will be described later, the evaluation module may use different 
values of the marketing campaign in this regard. The evaluation module 165 may use probability 
5 relations in making its determinations. For example, the evaluation module 165 may use a 

response prediction module 166 to determine the predicted response from individual customers. 
The response prediction module may use a "response, frequency, monetary" (RFM) analysis 
such as that available in products from SAP AG, Walldorf (Baden), Germany. For example, the 
response prediction module 166 may identify one or more customers that are very unlikely to 

10 generate profitable responses. This information may be used to remove the corresponding 

customer object from the target group such that no assignment(s) of that customer object to any 
of the marketing activities is made. 

The memory 160 may comprise constraint(s) 167 applicable to one or more marketing 
campaigns. For example, constraint(s) 167 may be defined by a user who is creating a marketing 

15 campaign in the system 100. The assignment module 163 or the evaluation module 165 may 
reject assignments of the customer objects 161 to the marketing activities 162 that are 
inconsistent with one or more of the constraints 167. The constraints 167 may be defined as 
upper or lower limits as applicable. 

The system 100 may create target group(s) 168 from some or all of the customer objects 

20 161. A target group 168 is a collection of those customer objects 161 to which at least one of the 
marketing activities 162 is to be directed. For example, if the system 100 identifies a particular 
assignment of the customer objects 161 to the marketing activities 162 as the most advantageous 
under the constraints 167, it may store the customer objects 161 as a target group 168 associated 
with its respective marketing activities 162. 
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The system 100 may include an execution module 169 that is capable of executing 
marketing campaigns comprising one or more marketing activities 162. The execution module 
169 may execute the marketing activities 162 toward the particular customer objects included in 
target group(s) 168. For example, when one of the marketing activities 162 comprises sending 
emails to the target group(s) 168, the execution module 169 may cause the emails to be sent 
using output devices 150. 

The system 100 may include a response detection module 170 that detects responses from 
the customers to the marketing activities 162. The response detection module 170 may detect the 
responses through input devices 130. For example, when a customer responds to a marketing 
activity 162 by email, the response detection module 170 may detect the email through input 
devices 130. 

The modules and other components just described in memory 160 could be combined or 
separated in various manners. They may be stored in RAM, ROM, or in combinations thereof, 
and they need not all reside in system 100 simultaneously. For example, the modeling of a 
marketing campaign and the execution of the marketing campaign, both of which will be 
described later, may be performed on different systems. 

Figure 2 shows an exemplary view 200 that may be displayed on the display device 140 
during operation of the system 100. The view 200 may be displayed when the system 100 is 
being used to model a marketing campaign 201. The view 200 may also be displayed when the 
system 100 is used for predicting the outcome of a campaign. Thus, the illustrative campaign 
201 could have been modeled in the system 100 or created elsewhere and imported to the system 
100, for example through input devices 130. 

It can be seen that three different types of graphical elements (to be described below) 
have been used in the campaign 201, for example: start step 202, prediction/decision ("p/d") step 
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203 and campaign step 204. The system 100 allows the user to associate the graphical elements 
with each other to indicate their relation. For example, the campaign 201 has arrows from one 
step to another to indicate the order of the steps. The system 100 may make templates of these 
steps available to the user in the view 200 so that the user can select one or more of them for the 
5 campaign 201, as appropriate. The system 100 may also make other steps and functions 

available for the user to apply to the campaign 201 that are not shown in view 200 for simplicity. 

The user may begin creating the campaign 201 using the start step 202. After the start 
step 202, the user may place a p/d step 203, followed by a first campaign step 204. At this or 
another stage, the user may decide which target group is to be used for the first campaign step 

10 204. The user may select the target group among those available in memory 160. For example, 
the user may decide to begin the campaign 201 with a target group consisting of all customers of 
record. The p/d step 203 may then predict the rate of response to the first campaign step 204 
from the customers in the target group. 

In an example of what the campaign 201 may include, the first campaign step 204 may 

15 include sending a letter to the customers in the target group. The result predicted in p/d step 203 
may comprise the information contained in Table 1. 



Table 1 



Campaign Value 


First Campaign Step: 
Letter 


Number of Customers in Target Group 


200,000 


Predicted Number of Responses 


9,450 


Predicted Response Rate (%) 


4.73 


Predicted Revenue ($) 


0 


Predicted Gross Profit ($) 


0 


Contact Costs ($) 


60,000 


Response Costs ($) 


0 


Predicted Net Profit ($) 


-60,000 



10 
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The target group contains 200,000 customers and the p/d step 203 predicts that 9,450 of 
them, or 4.73%, will respond to this type of letter. This response rate may have been determined 
using the response prediction module 166. In this example, the letter seeks a response from the 
customers indicating that they are interested in receiving further marketing material and/or offers 
5 (which will be included in subsequent campaign steps). The predicted revenue from the first 
campaign step 204 alone may therefore be zero. The contact costs refers to the cost in sending 
out the letters. This may be a value that the user enters into the system 100 and in this example it 
has been set at $60,000. Response costs will be described below but do not apply to the first 
campaign step in this example and are therefore set to zero. Accordingly, the predicted net 

10 "profit" from the first campaign step 204 is minus $60,000. Here, the p/d step 203 comprises 
predicting the values of the campaign 201 shown in Table 1 when all of the customers in the 
target group were subjected to the campaign step 204. Thus, the "decision" made in p/d step 203 
was to assign all of the customers to the same first campaign step 204. It will be described below 
how a p/d step may involve deciding to which of several possible campaign steps a customer 

1 5 should be assigned. 

A response collection step 205 may allow the system 100 to collect the received 
responses. For example, responses may be input to the system 100 using input devices 130. It is 
possible that customers will respond over a period of time, and the response collection 205 may 
for example be done continuously over that time period or at intervals or at some time prior to 

20 execution of the next step in the campaign 201 . 

The p/d step 206 evaluates the received responses and predicts the results of assigning the 
responding customers to one of the campaign steps 207, 208 and 209. In this example, campaign 
step 207 may involve mailing the company's shopping catalog to a target group; campaign step 
208 may involve mailing a brochure of the company's top-selling products to the target group; 
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and campaign step 209 may involve emailing an offer to the target group. To predict the results 
of these campaign steps, the costs of executing the respective steps per addressed customer must 
be known. Table 2 below lists exemplary values that may be used in p/d step 206. 



Table 2 





Camp, Step 207 
Man catalog 


Camp. Step 208 
lviau urocnure 


Camp. Step 209 

TP moil nffar 

ti mail jjiier 


Predicted 
Revenue per 
Response ($) 


115 


95 


85 


Profit per 

Response ($) 


78 


59 


65 


Cost per 
Contact ($) 


3 


2.50 


0.20 


Cost per 
Response ($\ 


0 


0 


8.50 


Response 
Model 


MAIL01 


MAIL02 


EMAIL01 


Default Rate 

(%) 


13 


15 


14 



5 For mailing the catalog (campaign step 207), the predicted revenue per response is $1 15. 

This average may be derived from the company's past sales experiences and may be a variable 
settable by the user. For example, the company may know that when customers place orders 
after receiving the company's catalog in the mail, the average buying customer places a $1 15 
order. Of the $1 15 revenue from an average response, the profit is $78. From this should be 

10 deducted the cost of the catalog and of shipping the catalog, here $3, which is labeled cost per 
contact. Thus, the predicted net profit for the average response is $75. 

In this example, the predicted revenue and profit per response and the costs per contact 
and response are based on average values. In other embodiments, one or more of them may be 
determined individually for each customer, for example as described below. 

15 The two other campaign steps have corresponding values, resulting in a predicted profit 

per response of $56.50 for mailing the brochure (campaign step 208) and $56.30 for sending the 

12 
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offer by email. In the latter calculation, a cost per response of $8.50 has been deducted from the 
profit per response. This may reflect a discount of the sales price that is given to the recipients of 
the email offer, which discount accordingly decreases the predicted net profit per response by an 
equal amount. Now, to determine the overall profit, it should be taken into account how many 
responses can be expected from the target group. 

Table 2 lists two ways of predicting the rate of responses. Response model means that 
the p/d step 206 involves using the response prediction module 166 to obtain a prediction based 
on the individual customers in the target group. Thus, the response rate predicted using this 
alternative may differ between different customers. Here, the illustrative response models used 
by the response prediction module 166 for the campaign steps 207, 208 and 209 are called 
MAIL01, MAIL02 and EMAIL01, respectively. The default rate, in contrast, which is listed 
below the response model in Table 2, may be an average response rate concluded without regard 
to the particular target groups. For example, the company may know from prior experiences that 
the average response rates for mailing catalogs is 8.5%, and that the average response rates for 
mailing brochures and sending offers by email are 6.3% and 4.5%, respectively. The default 
rates may be settable by the user. If the response model is unable to make a prediction for a 
customer, the default rate will instead be used for that customer. 

It now becomes desirable to specify the marketing campaign further by assigning 
customers to specific ones of the alternative second campaign steps 207, 208 and 209. The 
relevant customers for the second campaign step are those that were predicted to respond to the 
first marketing step. Table 1 shows that 9,450 customers were predicted to respond. 

The assignment module 163 may use an optimizing algorithm for this purpose. The 

algorithm may for example proceed by assigning all of the customers to various ones of the 

available campaign steps. For each assignment, the predicted value of the campaign resulting 

13 
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from the assignment is determined. It is also evaluated whether each assignment is consistent 
with the constraints 167 on the marketing campaign, if there are any. As long as the new 
assignments improve the predicted result, i.e. the goal value(s), the algorithm has not yet 
identified a maximum in the predicted result. Once all customers have been assigned to specific 
campaign steps, the algorithm may reassign individual customers to different campaign steps in 
an attempt to further increase the predicted goal value of the campaign and perhaps identify a 
global maximum of the goal value. 

Eventually, the algorithm may find a maximum, potentially a local maximum, which is 
here referred to as a best goal value. Having found a best goal value, the algorithm may then 
continue assigning and reassigning customers (without reassigning a customer to an old 
marketing activity) in an attempt to find a higher, perhaps global, maximum. During this search 
phase, the algorithm may tolerate a decrease in the goal value. 

The assignment module 163 may use different predicted values of the marketing 
campaign. For example, one or more of the costs of the campaign, the profits of the campaign, 
or the number of customers responding to the campaign may be used. In this regard, relative 
terms such as "increase," "maximum" etc. should be understood in context of the goal value that 
is being used. The object of the algorithm is to improve the goal value by making reassignments. 
Some goal values should be decreased to improve them. Thus, optimizing a goal value may 
involve minimizing it. 

The algorithm does not reassign a customer to a campaign step that the customer has 

previously been assigned to. Each assignment of a customer to a campaign step may be recorded 

in a suitable file, such as the binary map 164. For example, the binary map 164 may be an object 

representing a two-dimensional array of flags: one dimension is the customers and the other is 

the marketing activities. The possible assignments of 200,000 customers to five marketing 

14 



Attorney's Docket No.: 13906-132001 / 

activities then would require the object to have one million settable flags. The object may have 
suitable operations defined for it, such as for setting and reading individual flags. 

When a customer is assigned to one of the campaign steps, a flag corresponding to that 
assignment may be set in the binary map 164. By referring to the set flags in binary map 164 it 
can be ensured that no customer is reassigned to a campaign step that the customer has 
previously been assigned to. 

It is, however, possible that the algorithm will not find a higher maximum after "leaving" 
an earlier found maximum. The algorithm will come to a halt upon the occurrence of some 
interrupting event, such as a stop command from the system 100 or the user. For example, the 
algorithm may be terminated when the most recent 10,000 customer-activity reassignments have 
not improved the best goal value. 

One may determine the particular customer-activity assignments corresponding to the 
best goal value by reversing all assignments made since finding the most recent best goal value. 
It may therefore be desirable to record the assignments in a list as they are being made after 
finding a best goal value. The list may be stored in the memory 160. The algorithm may be 
configured to terminate the search if the best goal value has not been improved after a certain 
number of assignments. The assignments can then be reversed back to the best goal value using 
the list. In contrast, should the algorithm find a better goal value that is consistent with the 
constraint(s) 167, there will be no need to return to the previous, less good, goal value and it may 
then be desirable to purge the list. After termination, the best assignment of the customers to the 
campaign steps may be stored as a final assignment such that the marketing campaign can be 
executed according to that assignment. 



15 
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Using the best found assignment of customers to campaign steps it is possible to predict 
an overall result of the marketing campaign after the first and second campaign steps. Table 3 
shows the marketing campaign prediction of Table 1 updated with the values discussed above. 



Table 3 



campaign value 


Campaign 
oitrp. L/ciicr 


Second Campaign Step: 


TWal 1 ct an/1 
i UUll LSI auu 

2nd Steps 


Catalog 


Brochure 


Email 


Total 2nd 
step 




Number of 

i^i i ot"/~\m otp in 
V^/UblOIIlClb 111 

Target Group 


200,000 


5,500 


2,350 


1,600 


9,450 




PrprlirtpH Nnmhpr 

A LWUlvlV/U 1> Ul.ll.LJWl 

of Responses 


9 450 


717 


336 


224 


687 




Predicted 
Response Rate 

(%) 


4.73 


13.05 


14.3 


14 


7.3 




Predicted 
Revenue ($) 


0 


82,455 


31,929 


19,040 


133,424 


133,424 


Predicted Gross 
Profit ($) 


0 


55,926 


19,824 


14,560 


90,310 


90,310 


Contact Costs ($) 


60,000 


16,500 


5,875 


320 


22,695 


82695 


Response Costs 

($) 


0 


0 


0 


1904 


1904 


1904 


Predicted Net 
Profit ($) 


-60,000 


39,426 


13,949 


12,336 


65,711 


5,711 



Thus, the above assignment of customers to the respective campaign steps resulted in 



5,500 customers being assigned to campaign step 207, while 2,350 customers were assigned to 
campaign step 208, and 1,600 customers were assigned to campaign step 209. This resulted in 
the predicted net profits for the respective second campaign steps shown in the last row of Table 
3. The predicted total net profit for the campaign consisting of the first and second campaign 
steps was $5,711. 



16 
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It is possible that the algorithm will assign no customer to a particular campaign step. 
This suggests that based on the given set of addressable customers the campaign step should not 
be performed. 

However, a maximum goal value may correspond to several different assignments of the 
customer objects to the marketing activities. One way to handle such a situation involves the 
evaluation module using a second goal value in addition to the one currently being used. The 
assignment module 163 may then select the customer-activity assignment that is predicted to 
yield the best second goal value. 

Additional campaign steps may follow in the marketing campaign 201 . For example, 
Figure 2 shows that the responses from campaign step 208 are collected in step 210, which is 
followed by a p/d step 211. Response collection steps and additional campaign steps may follow 
after campaign steps 207 or 209 but have been omitted in Figure 2 for clarity. 

Prediction/decision step 211 may involve deciding which of campaign steps 212 and 213 
should be directed at the customers who responded to campaign step 208. The assignment of 
customers to campaign steps may be done as described above with regard to the p/d step 206. 
Here, campaign step 212 may be a follow up letter directed to the customers who responded to 
the brochure received by mail. Campaign step 213 may likewise be a follow-up email. 
Additional response collection steps and/or campaign steps may follow upon any of the 
campaign steps 212 and 213, or upon any response collection or campaign steps subsequent to 
the campaign steps 207 or 209. The graphical illustration of the marketing campaign 201 in 
view 200 may conclude with a "stop" symbol (not shown) similar to the start symbol 202. 

The predicted results may be used for several purposes. For example, the predicted 

profits for individual marketing activities may be analyzed. One characteristic that may be of 

interest is which marketing activities have relatively little impact on the outcome of the 

17 
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marketing campaign. If one of the marketing activities in Table 3, say the emailing step (209), 
yields a relatively small predicted profit compared to the other activities, it may be desirable to 
omit this marketing activity from the marketing campaign. This may conveniently be done by 
setting a constraint 167 that the total number of customers assigned to the emailing step must be 
zero. As another example, analysis of the predicted profits (or another predicted goal value) may 
suggest a fruitful way of expanding the campaign. Assume, for example, that a constraint for the 
catalog step in Table 3 limited the total number of catalogs mailed to 5,500. According to the 
prediction, increasing that number should yield an even higher net profit for that marketing 
activity. It may therefore be decided, in view of the predicted results, to alter or remove one or 
more constraints on the marketing campaign. 

Moreover, the entire campaign may be simulated by doing successive predictions of the 
individual steps, for example as will be described below. 

An exemplary operation of the system 100 will now be described with reference also to 
Figure 3. In step 301, the system 100 receives a request to initiate the modules and processes 
that are involved in assigning the customers to marketing activities in a marketing campaign. 
Such a request may be given by a user of the system 100, for example through input devices 130. 
It is assumed in this description that the system 100 has access to the information necessary to 
carry out the assignments and to predict the resulting outcomes of the marketing campaign. For 
example, the marketing campaign may previously have been modeled on the system 100 using 
graphical symbols in view 200, in analogy with the description of Figure 2 above. 

Step 302 comprises the overall process run by the assignment module 163 to assign the 

customer objects to the marketing activities. This process may involve several separate steps, as 

will be described. The assignment module 163 may take constraint(s) 167 into account in step 

303. For example, a constraint on the assignments may comprise that a certain customer should 
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only be contacted by mail. This constraint may preclude the assignment module from assigning 
that customer object to a marketing activity that involves contacting the customer in a way other 
than by mail. As another example, a constraint may prescribe that any customer for which the 
system 100 does not have a telephone number stored should not be assigned to a campaign step 
that involves calling the customer. 

The assignment module 163 may trigger the response prediction module 166 in step 304 
to predict the responses that may be received, using information known about the individual 
customers. In step 305, the evaluation module 165 determines a first predicted value of the 
marketing campaign based on the predicted response(s) for a particular assignment of the 
customers to the marketing activities. For example, the first predicted value may be a goal value 
of the campaign such as its predicted net profit. Thus, step 305 may involve the evaluation 
module 165 predicting the net profit of the marketing campaign for the current assignment of 
customers to the marketing activities. 

The evaluation module 165 in step 306 may take constraint(s) 167 into account in this 
determination and reject the particular assignment if it is not consistent with one or more of the 
constraints. The constraint may be one or more of a limitation on the marketing campaign, a 
limitation on the marketing activities, and a predicted number of customers responding to the 
campaign. For example, the marketing campaign may have constraints as to the total number of 
customers to be contacted in the campaign or the total number of customers to be contacted in 
any campaign step, which may be a limitation on the number of offers that are to be made in a 
campaign step. Additional examples of constraints include one or more of a budget for the 
marketing campaign, the predicted revenue, profits, or costs. Constraints may also be defined as 
a limitation on the communication channel (e.g., email or telephone) through which the 
customers will be contacted. 
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The assignment module may continue assigning and reassigning the customers to the 
marketing activities in step 302 consistent with the constraint(s) 167 as long as the first predicted 
value can be further improved. For each reassignment of the customers, the evaluation module 
165 may determine an updated first predicted value (step 305). However, the assignment module 
163 does not reassign a customer to a marketing activity that the customer has previously been 
assigned to. As part of step 302, the assignment module 163 may store each customer-activity 
assignment in the binary map 164, and refer to the binary map 164 to make sure that a customer 
is not reassigned to an old marketing activity. 

The assignment module ceases to perform step 302 upon the occurrence of some 
interrupting event, such as determining that the most recent, say, 10,000 reassignments of 
customers have not improved the goal value. The current assignment of the customers may then 
be considered the final assignment and the customers may be stored as target group 168 in step 
307. If the first campaign step should involve several possible marketing activities (as did the 
exemplary second campaign step in Figure 2), the customers may be stored in separate target 
groups 168. 

The system 100 executes the first campaign step in step 308. This may involve the 
assignment module 163 triggering the execution module 169 to perform the marketing activity/- 
ies of the first campaign step. For example, the execution module 169 may cause the output 
devices to send emails to selected customers in step 309. If the first step includes other 
marketing activities, such as sending letters to the customers, the execution module 169 may 
cause the letters to be automatically addressed to the customers and printed using the output 
devices 150. Other marketing activities may involve contacting the customers by telephone from 
a call center. The output devices 150 may be operably connected to the call center such that the 
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execution module 169 may provide the call center with the names, telephone numbers and other 
relevant information about the customers that are to be contacted though the call center. 

As discussed in the earlier examples, it is expected that customers will respond to the first 
marketing step, perhaps by placing an order with the company or by simply acknowledging their 
interest using a preformatted reply. However, the time during which the customers respond, and 
the way they communicate their response, may vary significantly. This is indicated by the 
dashed process flow from step 309 of performing the marketing activity to step 310 of receiving 
the customer responses. For example, customers may respond by emails that are received 
through the input devices 130. Another example is that a customer may respond through a 
website controlled by the company which channels the customer response to input devices 130. 
Additional ways for customers to respond include by letter, by telephone or fax, or by a personal 
contact with a company representative. In these examples, the customer response may be 
provided to system 100 in step 310 by entering the response information using input devices 130. 
For example, a visit activity report by the company representative may be typed in on a keyboard 
or provided as a data file from another computer. 

In step 31 1, the response detection module 170 detects the received response(s). The 
response detection module may correlate the received responses with the corresponding 
customer objects, which were used in executing the first campaign step. The detection of 
responses may also trigger the execution of a second campaign step (to be described below) 
toward the responding customers. It is possible to direct a subsequent campaign step toward 
customers that did not respond to the first campaign step, for example in the form of a reminder. 

In preparation for a second campaign step, the assignment module 163 in step 312 may 

assign the responding customers to marketing activities of the second campaign step. This may 

be carried out substantially as in step 302 above, with successive assignments and reassignments 
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of customers while minding the constraints on the marketing campaign. Step 312 may involve 
the same first predicted value (e.g., predicted net profit) as the first campaign step or it may 
involve a different value. Similar to step 302 above, the assignment module 163 does not 
reassign a customer to a marketing activity that the customer has previously been assigned to, for 
example using the binary map 164 to record each assignment. 

With the assignment module 163 having arrived at a final assignment of the customers in 
step 312, the execution module 169 in step 313 executes the second campaign step. Similar to 
the description of the first campaign step above, this may involve performing marketing 
activities through output devices 150 in step 314. For clarity, Figure 3 does not show any steps 
subsequent to step 314, but it will be understood that the marketing campaign may continue 
along the lines described with regard to the first campaign step. That is, following the marketing 
activity/-ies being performed in step 314, there may be a subsequent reception and detection of 
customer responses, possibly followed by assignment of customers to marketing activities for a 
third campaign step, and so on. 

Response Sampling 

It will now be described an example of predicting the outcome of a marketing campaign 
having more than one campaign step. With reference again to Figure 2, the p/d step 203 involves 
predicting the number of customers responding to campaign step 204. In order to predict the 
outcome of a subsequent step, such as any of campaign steps 207, 208 or 209, it becomes 
desirable to predict not just how many customers will respond to the previous step, but to predict 
who they may be. To predict who the customers may be, one should create a target group that is 
representative of the customers that will respond to the campaign step. By selecting customers 
from the first target group according to their individual response probabilities, a sample second 
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target group can be generated that is representative of the responding customers. Such a sample 
target group can be used to predict the outcome of subsequent campaign steps. 

Figure 4 includes steps of a process that may be performed to predict the outcome of a 
campaign having more than one step. In step 401, a request to initiate the procedure is received 
through the input devices 130. In other embodiments, a system according to the invention may 
initiate the process without specific user input. 

The assignment module 163 begins compiling customer objects in step 402. The 
assignment module will use the customer objects to create a target group for the first campaign 
step. The assignment module takes assignment constraints into account in step 403. The request 
that was input in step 401 may have specified that the assignment module create a target group 
with particular characteristics, such as all customers who are women and who live in New York. 
The assignment module identifies those among customer objects 161 that meet the constraints. 
In this example, there are 287,400 such customers. 

It is possible to specify the maximum size of the target group to be created. In this 
example, the request received in step 401 specified that no more than 200,000 customers be 
included in the target group. Using the response prediction module 166, the customers' 
individual response probabilities may be determined in step 404, and the customers having the 
lowest response probabilities may be eliminated to reduce the number of customers to the 
requested size. This should maximize the number of responses that can be expected from the 
customers. The 200,000 customer objects are stored as the first target group in step 405. 

In step 406, the response prediction module predicts how many responses will be 

received if the first campaign step were carried out toward the first target group. In this example, 

it is predicted that 9,450 customers respond to the first campaign step. The evaluation module 

165 can use this predicted number in step 407 to determine a predicted value of the marketing 
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campaign so far. The predicted value and any other relevant information may be displayed to the 
user in step 408. For example, the output devices 150 may display information corresponding to 
that contained in Table 1 above. In other embodiments, the display may be made after 
subsequent calculations are complete. 

In step 409, the assignment module compiles customer objects for a second target group, 
using their individual response probabilities. The response probability for a customer may be 
obtained by combining information that is known about the customer with statistics regarding 
how such information correlates with a tendency to respond to campaigns. For example, the 
customer's past purchasing behavior, such as how recently she made a purchase, how frequently 
she makes purchases, and how much money she spends on purchases, may be taken into account. 
This information is sometimes referred to as descriptors and may be stored with the customer 
object. It can also be determined whether there is any statistically significant correlation 
between the presence of a descriptor in customers and their response to actual campaigns. A 
significant correlation may be used to predict the likelihood that a customer having that 
descriptor will respond to a similar future campaign; that is, it can be used to determine the 
customer's response probability. 

As an example, assume that each of the 200,000 customers in the first target group have 
individual response probabilities within the range of 0 to 1. The response probabilities are used 
in selecting customers for a second target group. The assignment module may use a random- 
number generator to randomly generate a number between 0 and 1, the range of the response 
probabilities, for each customer in the first target group. If the randomly generated number is 
less than the customer's response probability, the assignment module includes that customer in 
the second target group. If the randomly selected number is equal to, or greater, than the 
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customer's response probability, the assignment module does not include that customer in the 
second target group. 

This procedure is performed for all customers in the first target group to identify a 
number of customers for the second target group. However, the number of customers that are 
initially identified may be somewhat greater or smaller than the number of responses that was 
predicted in step 406. If the second target group is initially too large, the assignment module 
may sort the customers in the second target group according to their individual response 
probabilities and then remove the customers that have the lowest response probabilities. If, on 
the other hand, the second target group is initially too small, the assignment module may sort the 
customers in the first target group that were not selected for the second target group according to 
their individual response probabilities. The assignment module then adds the customers with the 
highest response probabilities to the second target group. Thus, the assignment module adjusts 
the number of customers in the second target group to be equal to the predicted number of 
responses. The assignment module stores the second target group in step 410. 

Adjusting the number of customers in the second target group has the advantage that the 
numbers that are displayed to the user are consistent with each other. In the above example, if 
the number of predicted responses (9,450) is initially displayed to the user, the user may expect 
the second target group to contain exactly this number of customers. Thus, adjusting the second 
target group may satisfy the user's expectations. It has been found, however, that adjusting the 
second target group as described above may have very little or no impact on statistical accuracy 
and reliability as long as it is substantially equal to the predicted number. This holds true when 
the second target group is sufficiently large in statistical terms to be representative of the 
responding customers. Therefore, adjustments are not essential in obtaining a reliable predicted 
result. 
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If the second campaign step includes alternative marketing activities, such as the 
campaign steps 207, 208 and 209, the customers may be assigned to the campaign steps using an 
optimizing algorithm. For example, the algorithm described above with reference to Figure 3 
may be used. That is, the assignment module may assign and reassign customers to the 
alternative second campaign steps while evaluating the predicted outcome of the second 
campaign step, without reassigning a customer to a campaign step to which the customer has 
previously been assigned. In this example, it is determined that customers should be assigned to 
the alternative campaign steps as follows: 5,500 customers assigned to campaign step 207, 2,350 
customers assigned to campaign step 208, and 1,600 customers assigned to campaign step 209. 

In step 41 1, the response prediction module predicts the number of responses to be 
received if a second campaign step were performed toward the second target group. In this 
example, it is predicted that 578 customers will respond to campaign step 207, 202 customers 
will respond to campaign step 208, and 1014 customers will respond to campaign step 209. The 
evaluation module determines the predicted value of the marketing campaign in step 412. The 
evaluation module uses the predicted number of responses, the costs of contacting the second 
target group, and the profits per responding customer in this determination. The prediction for 
the first and second steps of the marketing campaign is displayed in step 413. 

The simulation of the marketing campaign may end after prediction of the second step, or 
it may continue as indicated by the dashed arrow from step 413. Accordingly, it is possible to 
simulate marketing campaigns having more than two consecutive campaign steps by creating 
subsequent sample target groups in analogy with the description of the second target group above 
for each campaign step subsequent to the second campaign step. 

Customer-Specific Marketing-Campaign Value Prediction 
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In Table 2 above, the four first rows contained average values for predicted revenue and 
profit per response, cost per contact and response cost. One or more of such values may instead 
be determined specifically for particular customers. That is, the system may determine, say, the 
predicted revenue individually for particular customers and use those customer-specific values in 
5 the prediction of a marketing campaign. The values described here, and others not mentioned, 
are collectively referred to as response values. They relate to the value of a response from the 
customer and indicate predicted values of a response from the customer. 

With reference again to Figure 1, the response prediction module 166 may determine a 
response probability for each customer in a target group towards which a marketing campaign 

10 should be directed. As has been described above, the response prediction module 166 may do so 
using a response model. The evaluation module 165 may determine a response value for each of 
the customers. The response value indicates a predicted value of a response to the marketing 
campaign by the customer, such as the predicted revenue or profit. The evaluation module 165 
may predict an outcome of the marketing campaign using the response probability and the 

15 response value. Examples of determining the response values will be described later. 

Customer-specific response values can be used in the situations described earlier where 
the system 100 is used for predicting outcomes of marketing campaigns. For example, when a 
marketing campaign includes alternative campaign steps, such as steps 207, 208 and 209 in 
Figure 2, the assignment module 163 can try different assignments of customers to the 

20 alternative campaign steps, and the corresponding outcome of the marketing campaign can be 
evaluated. Specifically, when the evaluation module 165 determines the first predicted value in 
step 305 (see Figure 3), it may use a customer specific response value to predict the outcome of a 
particular assignment of the customers to the campaign steps. Thus, each evaluation of a 
particular customer-campaign step assignment may involve determining the response probability 
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for a particular customer, determining the response value of that customer, and predicting the 
response from that customer, that is, predicting the outcome of the marketing campaign in this 
regard. 

Moreover, the response sampling described above with regard to marketing campaigns 
having more than one step may also involve customer specific response values. In response 
sampling, a target group may be generated that is representative of customers who are likely to 
respond to an earlier campaign step. The response sample target group may be used for 
predicting subsequent steps of the marketing campaign. For example, the response prediction 
module 166 may determine a response probability for the customers in the response sample 
target group, the evaluation module 165 may determine a response value for each of the 
customers, and may predict an outcome of a campaign step directed at the response sample target 
group using the response probabilities and the response values. 

The response values may be obtained using techniques similar to those described above 
with regard to the customers' individual response probabilities. That is, a customer's past 
behavior, such as the amount of money she spends in each transaction or the regularity of 
transactions, may be taken into account. One exemplary application involves the renewal of 
subscription services. Assume that a company that provides cell phone services offers 
subscription contracts of varying length. An existing customer who wishes to renew her 
subscription can choose between prolonging the contract by, say, one, six or twelve months. In 
this example, the company has a purchase history for the customer showing that of the five times 
that the customer has renewed her contract, she has chosen the twelve-month option twice, the 
six-month option once and the one-month option two times. The length of the contracts, in turn, 
correspond to different revenue, profits, etc. for the company. Accordingly, the customer's 
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purchase history indicates what revenue, profit, etc. can be expected when the current service 
contract expires. 

Similarly to the individual response probabilities described above, the customer's past 
purchase behavior can be treated as descriptors to be used in predicting the outcome of 
marketing campaigns directed at the customer. That is, it can be determined whether there is a 
statistically significant correlation between the presence of a descriptor — say, the customer 
having ordered a twelve-month subscription — and the customer's response to the marketing 
campaign. For example, the fact that a customer has always signed up for twelve-month 
subscription on past occasions would be a relatively strong indicator of what the customer will 
do at the end of the current subscription. In contrast, with a customer that has always chosen the 
one-month alternative, the likelihood of now selling a twelve-month option appears to be 
smaller. 

As another example, consider a seller of products that records the purchases of its 
customers. A customer's purchase history may include a certain number of items in the $l-$49 
range, some in the $50-$99 range, and some products costing $100 or more. This data gives an 
indication of the level of purchase that can be expected from the customer in the future. 
Accordingly, the customer's purchase history may be used in deriving the response value for a 
future marketing campaign. 

As yet another example, it is possible to derive a response value where the customer does 
not yet have a purchase history or where the purchase history is not available. The purchase 
history of similar customers may be used to obtain a response value for the customer. The 
selection of similar customers may be based on certain characteristics recorded for the 
customers. For example, one or more aspects of customer demographics may be used to identify 
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similar customers, and the purchase history of at least one similar customer may be used to 
obtain a response value for the customer not having a purchase history. 

As is known in statistical marketing analysis, dated or otherwise less reliable data may 
skew the prediction(s). For example, if the customer years ago made a series of high-value 
5 purchases, but in recent years consistently has bought less expensive items, the earlier records 
may tend to overestimate the customer's next probable purchase. Accordingly, it may be 
desirable to weigh some or all of the available data in determining the response value. 

Moreover, the response value may be determined for a specific marketing step. That is, 
the customer's purchase history may indicate that the customer generates a different revenue for 
10 the company following personal visits by a sales representative than in response to an offer by 
email. Accordingly, the kind of marketing step — whether it be an email message, website 
advertisement, a letter, a telephone call, a fax transmission, a personal contact or some other 
form of communication — may be taken into account in deriving the response value. 

Similar to Table 2 above, the following table is an example of how the campaign 
15 prediction may take customer-specific values into account. 



Table 4 





Camp. Step 207 
Mail Catalog 


Camp. Step 208 
Mail Brochure 


Camp. Step 209 
Email Offer 


Revenue Model 


REVENUE01 


REVENUE02 


REVENUE03 


Default 
Revenue per 
Response ($) 


115 


95 


85 


Profit Model 


PROFIT01 


PROFIT02 


PROFIT03 


Default Profit 
per Response 
($) 


78 


59 


65 


Cost Model 


COST01 


COST02 


COST03 


Default Cost 
per 

Contact ($) 


3 


2.50 


0.20 
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Camp. Step 207 
Mail Catalog 


Camp. Step 208 
Mail Brochure 


Camp. Step 209 
Email Offer 


Cost-per- 
Response 
Model 


CPR01 


CPR02 


CPR03 


Default Cost 
per 

Response ($) 


0 


0 


8.50 


Response 
Model 


MAIL01 


MAIL02 


EMAIL01 


Default Rate 

(%) 


13 


15 


14 



For each response value — revenue per response, profit per response, cost per contact and 
cost per response — Table 4 lists an exemplary model that may be used in obtaining the customer- 
specific response value. For example, the revenue model for campaign step 207 is here named 
REVENUE01, the profit model for campaign step 208 is named PROFIT02, etc. In analogy with 
the response prediction model described above, each model can be applied to the individual 
customer object. For example, the revenue model REVENUE01 may be applied to a specific 
customer to determine a response value that indicates the predicted revenue resulting from 
directing campaign step 207 at the customer. The evaluation module 165 may determine 
individual contact costs by applying the specifics of the mode of contact (e.g., a personal visit by 
a sales representative) to the particulars of the current customer. For example, the number of 
hours needed for a visit can be estimated from the customer's geographic location, and the hours 
can be multiplied with the hourly cost of the sales representative. These characteristics are part 
of applying the cost model to the individual customer. Similarly, the cost per response can 
reflect a discount typically given to a particular customer, and this will be brought into the 
campaign prediction by applying the cost-per-response model to the customer. 

It was described above how the individual response probabilities may be determined 

using a response prediction module 166 and the exemplary response models MAIL01, MAIL02, 
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etc. The exemplary response models REVENUE01, REVENUE02, etc. may be accessed in a 
similar way. That is, in an example where the response models are implemented in software, 
they may be accessible in the response prediction module 166, or in a similar but separate 
module in the system 100, or in the evaluation module 165, or elsewhere. Accordingly, the 
evaluation module 165 may determine response values by accessing the appropriate response 
model(s) included in its own program instructions, or in a separate response prediction module, 
or in another location, as the case may be. The response value determined by the evaluation 
module 165 can then be used — together with the response probability — in predicting an outcome 
of the marketing campaign. 

On the rows beneath the respective response models, Table 4 also includes the average 
values for revenue, profit, cost per contact and cost per response. In this example, the values are 
the same as those used in Table 2. Accordingly, when a response value cannot be determined for 
a customer, the evaluation module 165 may use the average values as defaults. 

Embodiments in General 

The invention can be implemented in digital electronic circuitry, or in computer 

hardware, firmware, software, or in combinations of them. Apparatus of the invention can be 

implemented in a computer program product tangibly embodied in an information carrier, e.g., in 

a machine-readable storage device or in a propagated signal, for execution by a programmable 

processor; and method steps of the invention can be performed by a programmable processor 

executing a program of instructions to perform functions of the invention by operating on input 

data and generating output. The invention can be implemented advantageously in one or more 

computer programs that are executable on a programmable system including at least one 

programmable processor coupled to receive data and instructions from, and to transmit data and 

instructions to, a data storage system, at least one input device, and at least one output device. A 
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computer program is a set of instructions that can be used, directly or indirectly, in a computer to 
perform a certain activity or bring about a certain result. A computer program can be written in 
any form of programming language, including compiled or interpreted languages, and it can be 
deployed in any form, including as a stand-alone program or as a module, component, 
subroutine, or other unit suitable for use in a computing environment. 

Suitable processors for the execution of a program of instructions include, by way of 
example, both general and special purpose microprocessors, and the sole processor or one of 
multiple processors of any kind of computer. Generally, a processor will receive instructions and 
data from a read-only memory or a random access memory or both. The essential elements of a 
computer are a processor for executing instructions and one or more memories for storing 
instructions and data. Generally, a computer will also include, or be operatively coupled to 
communicate with, one or more mass storage devices for storing data files; such devices include 
magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and 
optical disks. Storage devices suitable for tangibly embodying computer program instructions 
and data include all forms of non- volatile memory, including by way of example semiconductor 
memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as 
internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM 
disks. The processor and the memory can be supplemented by, or incorporated in, ASICs 
(application-specific integrated circuits). 

To provide for interaction with a user, the invention can be implemented on a computer 
having a display device such as a CRT (cathode ray tube) or LCD (liquid crystal display) 
monitor for displaying information to the user and a keyboard and a pointing device such as a 
mouse or a trackball by which the user can provide input to the computer. 
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The invention can be implemented in a computer system that includes a back-end 
component, such as a data server, or that includes a middleware component, such as an 
application server or an Internet server, or that includes a front-end component, such as a client 
computer having a graphical user interface or an Internet browser, or any combination of them. 
The components of the system can be connected by any form or medium of digital data 
communication such as a communication network. Examples of communication networks 
include, e.g., a LAN, a WAN, and the Internet. 

The computer system can include clients and servers. A client and server are generally 
remote from each other and typically interact through a network, such as the described one. The 
relationship of client and server arises by virtue of computer programs running on the respective 
computers and having a client-server relationship to each other. 

A number of embodiments of the invention have been described. Nevertheless, it will be 
understood that various modifications may be made without departing from the spirit and scope 
of the invention. Accordingly, other embodiments are within the scope of the following claims. 
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